black box functionality
Deep learning models hampered by black box functionality
The financial services industry has been slow to embrace deep learning for fear of this black box, Maynard said. Nobody doubts that advanced techniques, like neural networks, could help financial companies make better decisions. But, for Equifax, regulations force them to give verbal explanations for why people receive the credit scores that they do. Simply saying, "because a neural net said so," isn't good enough. So Maynard and his team have developed a new type of neural network model that gives reason codes along with scores.